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Abstract 



In this article, we present a new algorithm for computing generating sets and 
Grobner bases of lattice ideals. In contrast to other existing methods, our algo- 
rithm starts computing in projected subspaces and then iteratively lifts the results 
back into higher dimensions, by using a completion procedure, until the original 
dimension is reached. We give a completely geometric presentation of our Project- 
and-Lift algorithm and describe also the two other existing main algorithms in this 
geometric framework. We then give more details on an efficient implementation of 
this algorithm, in particular on critical-pair criteria specific to lattice ideal com- 
putations. Finally, we conclude the paper with a computational comparison of our 
implementation of the Project-and-Lift algorithm in 4ti2 with algorithms for lattice 
ideal computations implemented in CoCoA and Singular. Our algorithm outper- 
forms the other algorithms in every single instance we have tried. 
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1 Introduction 

In this article, we present a new algorithm for computing a generating set of 
a lattice ideal 



Email addresses: hemmecke@math.uni-magdeburg.de (Raymond Hemmecke), 
malkin@core.ucl.ac.be (Peter N. Malkin). 

1 This work was supported by the European TMR network ADONET 504438. 



1(C) := (x 



+ 



x u :ueC)C k[xi 




Preprint submitted to Elsevier Science 



2 February 2008 



where k is a field, £ is a sub-lattice of Z n , and 
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where w+ = max{«j, 0} and u~ = max{— w i; 0}. We assume that £flN n = {0}. 
Generating set and Grobner basis computations for general ideals are usually 
very time consuming. Fortunately, in the special setting of lattice ideals, many 
improvements are possible. Two interesting areas of application of lattice ideals 
are algebraic statistics and integer programming. 

In general, a generating set of 1(C) is not readily available. For a basis S of the 
lattice C over Z n , the ideal J(S) := (x u+ - x u ~ : u G S) satisfies J(S) C 1(C), 
but usually one may not expect that J(S) = 1(C). Also, when computing a 
Grobner basis of a lattice ideal, computational experiments show that when 
C n N n = {0}, the computation of a generating set usually takes much longer 
than computing the Grobner basis from the generating set. 



Generating sets of lattice ideals and Grobner bases o f lattice ideals h a ve cor - 



responding g eomet ric concepts (see iThomasJ (|l995h : llJrbaniak etHl (|l997t) : 



Weismantell ( 19981 )). which we call generating sets of lattices and Grobner 
bases of lattices respectively (see Section 2). These concepts are related as 
follows: if a set S C C is a generating set of £ or a Grobner basis of C with 
respect to a term order >-, then G := {x u+ — x u : u G S} is respectively a 
generating set of 1(C) or a Grobner basis of 1(C) with respect to and also, 
if a set of monic binomials G is a generating set of /(£) or a Grobner basis 
of 1(C) with respect to a term order then S := {a — (3 : x a — x 13 G G} is 
respectively a generating set of £ or a Grobner basis of C with respect to >-. 
Note that we use the same order y for monomials and vectors via the relation 
x a y x 13 if and only if a y [3 for a, (3 G N n . Also, note that any minimal 
reduced Grobner basis of a lattice ideal is a set of monic binomials. 



In this paper, we have chosen to present existing theory an d the new algo - 
rithm only in a geomet ric fr amework following the approach in lThomas!(|l995h . 
Urbaniak et"aiT(|l997h . and IWeismantel {l998), since for lattice ideals, we pre- 
fer the geometric approach to the algebraic one. However, note that for every 
geometric concept presented, there exists an equivalent algebraic notion, al- 
though we do not present it here. Also, we have tried to make this paper 
reasonably self contained, so for completeness, we present geometric proofs of 
existing results where pertinent. 



Recently, there has been renewed interest in toric ideal computations because 
of applications in algebraic statistics. Here, we are interested in Markov bases, 

which are used in a Monte-Carlo Markov-Chain (MCMC) pro cess to test valid- 

ity of statistical models via sampling. Diaconis and Sturmfels f Diaconis and Sturmfeld . 
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1998]) showed that a (preferably minimal) generating set of a lattice 

L A := {u G Z n : Au = 0} 

for some matrix A G Z dxra is a Markov basis. Note that I{Ca) is a toric ideal. 
However, at that time, no effective implementation of an algorithm to compute 
generating sets of toric ideals was available that could deal with moderate size 
problems in 50 — 100 variables. This situatio n has changed by now: se veral such 
implementation s are avai l able. Using 4ti2 ( Hemmecke et al. . 20051 ). Eriksson 



even reports, in Eriksson! (J2004), on successful computations of Grobner bases 
and Markov bases of toric ideals in 2, 048 variables. His problems arise from 
phylogenetic trees in computational biology. 

In integer programming, test sets of integer programs corresp ond to Grobne r 
bases of lattices (or lattice ideals). Test sets were introduced in Graver ( 19751 ). 
Consider the general linear integer program 

min{cZa : Az — b, z & > 0, z G Z n } 

where c G Q^l, A G Z dxn , b G Z rf , a C {l,...,n}, a := {1, n} \ a, and 
where z& is the set of variables indexed by a. An y integer program that ha s 
an optimal solution can be written in this form (|Conti and Traversol . 1991 ). 



By projecting onto the a variables, we can rewrite these integer programs in 
the equivalent and more convenient form 

IPl c h = mm{cz : A- a z = b (mod A a Z), z G 

where A a and are the sub-matrices of A whose columns are indexed by a 
and a respectively, and A a 7j := {A a z : z G Z' CT '}. In the special case where 
cr = 0, we set AJL := {0}, and the problem IP\ cb simplifies to IPa,c}> '■ = 
min{c,2 : Az = b,z G N"}. Note that group relaxations and extended group 
relaxations of IPA.r.h are als o of the form IP^ 5b for some cost vector c G Q' CT ' 
( Hosten and Thomasl . l2002| ) . Without loss of generality, we assume that c is 



generic meaning that IP a c b has a unique optimal solution for every feasible 
b G Z d . We can always easily perturb a given c so that it is generic. 

A set T C Z'°"' is called a test set for lP A T ch if T contains an improving 
direction t for every non-optimal feasible solution z G of JP^ c6 ; that is, 
z — t is also feasible and c(z — t)< cz. Clearly, z — t being feasible implies that 
t is an element of the lattice 

L\ := {u G Z |ff| : A- a u = (mod A a Z)}. 

Moreover, a set T C C A is called a test set for IP Ac the class of integer 
programs IP Acb for all b G Z d , if T is a test set for every integer program in 
IP Ac- Graver showed that there exist finite sets T that are test sets for IPa, c 
(a = 0). In fact, his sets also constitute finite test sets for IPj[ c for arbitrary 
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a. Having a finite test set available, an optimal solution of IP% c ^ can be found 
by iteratively improving any given non-optimal solution of IP% c j,. 



In Conti and Traverse! (1991) and Sturmfels et al. ( 1995[ ). it was shown that 



given a generic cost vector c and a term order y where c and >- are compatible, 
a set S C C A is a Grobner basis of C A with respect to a y if and only if S is a 
test set for IP Ac where c and y are compatible if ca > c(3 implies a y (3 for 
all a, /? £ N n . A compatible term ordering >- exists for every generic c, and a 
compatible generic c exists for every term ordering Additionally, any lattice 
C can be written in the form C A for some matrix A 6 Z nxd and some index 
set a C {1, ...,n}, and so, Grobner bases of lattices and test sets of integer 
programs really are equivalent concepts. 

We define generating sets and Grobner bases of lattices, in Section 2. in a 



geometric context and present the completion procedure ([Buchbergerl . 11987 



198ilGox etldl . Il992h . which is the main building block for the algorithms 



for computing generating sets. 

In Section 3, we present the two main existing algorith ms for computing gen- 
eratin g sets: the algorithm of Hosten and Sturmfels in Hosten and Sturmfels! 



( 1995b . which we call the "Sat uration" algor i thm; and the algorithm of Bi 



gatti, LaScala, and Robbiano in Bigatti et al. ( 19991 ). which we call the "Lift 



and-Project" algorithm. We also describe our new algorithm for computing 
generating sets: the "Project-and-Lift" algorithm. The Saturation Algorithm 
is based upon the result that 1(C) — (. . . ((J(S) : x^°) : x??) . . .) : where 
S is a lattice basis of C and J(S) is defined as above. Using this result, we 
can compute a generating set of 1(C) from S via a sequence of saturation 
steps where each individual saturation step is performed via the completion 
procedure. The Lift-and-Project Algorithm is based upon the related result 
that 1(C) = J(S) : (xi • %2 • ■ ■ ■ • x n )°° . Here, a generating set is computed 
via the completion procedure using an additional variable. The Project-and- 
Lift Algorithm is strongly related to the Saturation Algorithm; however, the 
computational speed-up is enormous as will be seen in Section 7. In contrast 
with the Saturation Algorithm, which performs saturation steps in the origi- 
nal space of the lattice C, the Project-and-Lift Algorithm performs saturation 
steps in projected subspaces of C and then lifts the result back into the original 
space. 

We are mainly interested in computing a generating set of C where C fl N n = 
{0}. However in Section 4, we address the question of how to compute a 
generating set C if C fl N n ^ {0}. We demonstrate that the above methods 
for the case where C fl N" ' = {0} can be extended to this more general case; it 
happens to be more straight-forward in some ways. 

The completion procedure as it is presented in Section 2 is not very efficient. In 
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Section 5, we show how to increase the efficiency of the completion procedure. 
All the results in this section, which we present in a geometric framework, have 
corresponding results in an algebraic context. This section is rather technical 
and no other section depends upon it, so it may be skipped on first reading. 

In Section 6, we give the solution of a computational challenge posed by Seth 
Sullivant to compute the Markov basis of 4 x 4 x 4 tables with 2-marginals, a 
problem involving 64 variables. We solved this with the help of the new algo- 
rithm. Our computations led to 148, 968 elements in the minimal generating 
set of 1(A) which fall into 15 equivalence classes with respect to the underlying 
symmetry group S4 x £4 x S4 x S3. 



In Section 7, we compare the perf ormance of the implemen tation of the Project- 
and-Lift algorithm in 4ti2 v. 1.2 ( Hemmecke et all 2005T ) with the implemen- 
tation of the Saturation algorith m and the Lift-and- Project algorithm i n Sin- 
gular v3.0.0 (lOreuel et all T2005) and in C0C0A 4.2 (ICoCoATeaml . l2005h . The 
Project-and-Lift algorithm is significantly faster than the other algorithms. 



2 Generating sets and Grobner bases 



Given a lattice £CZ", and a vector b G Z n , we define 

F c ,b ■= {x : x = b (mod £),x G N n }. 

For S C £, we define G(Fc,b, S) to be the undirected graph with nodes T c.b 
and edges (x, y) if x — y G S or y — x G S for x, y G Tc,b- 

Definition 1 A set S C £ a generating set of C if the graph Q{Tc,bi S) is 
connected for every b G Z n . 

We remind the reader that connectedness of G(J r c ! b,S) simply states that 
between each pair x,y G J-'cfi, there exists a path from x to y in G^cbiS). 
Note the difference between a generating set of a lattice and a spanning set 
of a lattice: a spanning set of £ is any set S C £ such that any point in 
£ can be represented as an linear integer combination of the vectors in S. A 
generating set of £ is a spanning set of £, but the converse is not necessarily 
true. 

Recall that for any lattice £, we have £ = £ U A for some some matrix A G Z" ,xd 
and some index set a C {1, n}. Hence, 

F Cb = f° Al ■= { x gN 1 * 1 : A- a x = b (mod A a Z)} 
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for all b E Z n and all b E Z d where b = A^b. So, Tc,b and T a A i are dual 
representations of feasible sets. 

Example 2 Let S :={(l,-l,-l,-3,-l,2), (1,0,2,-2,-2, 1)}, and let C C Z 6 be the 

lattice spanned by S. So, by definition, S is a spanning set of C, but S is not 
a generating set of C Observe that C = La where 



A = (A,I), A 



(-2 -3\ 
+2 -1 
+2 +1 

V-i +v 



and I 



1 (A 
10 
10 
1/ 



So, for every b E Z 6 , T c ,b = ? \l = {(x, s) : Ax + Is — b,x E N 2 , s E N 4 } 
where b = Ab E Z 4 . Hence, the projection of Tc,b onto the (xi,x 2 )-plane is the 
set of integer points in the polyhedron {x E K™ : Ax < b}, and the s variables 
are the slack variables. Consider b := (2,2,4,2,4, 1); then, Tc,b = J~aI where 
b = Ab =(-6,4,10,1) (see Figure la). 
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Fig. 1. The set Tc,b and the graphs Q{Tc t b-,S) and ^(^x,b,S") projected onto the 
(xi, X2)-plane. 

The graph Q{? £ ;6 , S") noi connected because the point (3, 4, 12, 2, 0, 0) G Tc,b 
is disconnected (see Figure lb). Let S' := SU-J^l, 1,5,-1,-3,0)}. The graph of 
Q{Tc,bi <S") nc,,w connected (see Figure lc); however, S' is still not a gen- 
erating set of £ since we have Tcy = {(0, 0, 0, 0, 1, 1), (0, 1, 3, 1, 0, 0)} for 
b' : = (0,0,0,0,1,1), and the graph Q{Tc,b^ S') is disconnected; since there 
are only two feasible points in Tap , the vector between them (0,1,3,1,-1,-1) 
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must be in any generating of C. Finally, the set S" := <S"U{(0, 1,3, 1,-1,-1)} is 
a generating set of C 

For the definition of a Grobner basis, we need a term ordering y for C. We 
call y a term ordering for C if y is a total well-ordering on Tc,b f° r every 
b G Z n and >- is an additive ordering meaning that for all b G Z n and for 
all x,y & J-'cfi, if x y y, then x + 7 >- y + 7 for every 7 G N n (note that 
^ + 1, 2/ + 7 e •^£,6+7) ■ We also need the notion of a decreasing path: a path 
(x°, . . . , x fe ) in G(!Fc,bi G) is ^-decreasing if x* >- x i+1 for i = 0, . . . , k - 1. 
We define C y := {u e £ : u + y u~}. 

Definition 3 A set G C £^ a > — Grobner basis of C if for every igN" 
there exists a y -decreasing path in G{J-c,x, G) from x to the unique y -minimal 
element in J~c,x- 

If G C C y is a ^-Grobner basis, then G is a generating set of £ since given 
x, y G Q (J-'cfi, G) for some 6 G Z n , there exists a >~ decreasing path from x to 
the unique minimal element in J-'cfi and from y to the same element, and 
thus, x and y are connected in G(J-c,b,G). Also, G C £ y is a Grobner basis 
if and only if for every x G N n , x is either the unique >-- minimal element in 
J~c.fi or there exists a vector u G G such that x — w G b and x y x — u; 
consequently, a Grobner basis G is a test set for IP% C where £^ = C if c and 
>- are compatible. 

The defining property of a Grobner basis is very strong, so we redefine it in 
terms of reduction paths. A path (x°, . . . , x k ) in G{J-c,b, G) is a ^-reduction 
path if for no % G {1, . . . , k — 1}, we have x l y x° and x* >- x k . For example, 
see Figure 2. 
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Fig. 2. Reduction path between x and y. 



Lemma 4 A set G C is a y -Grobner basis of C if and only if for each 
b G Z n and /or each pair x,y G .T 7 /;,;,, i/iere exzsfo a y-reduction path in 
G(J-c,b, G) between x and y. 

Proof. If G (J-'cfi, G) contains ^-decreasing paths from x,y G Tc,b to the 
unique ^-minimal element in J-'cfi, then joining the two paths (and removing 
cycles if necessary) forms a ^-reduction path between x and y. 

For the other direction, we assume that there is a ^-reduction path between 
each pair x, y G J-'cfi- Denote by x* the unique ^-minimal element in J-'cfi', 
thus, every x G .Fc^ is connected to x* by a ^-reduction path. In particular, 
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by the definition of a ^-reduction path, if x 7^ x*, then the first node x 1 7^ x 
in this path must satisfy x >- x l . Repeating this argument iteratively with x 1 
instead of x, we get a ^-decreasing path from x to x*. This follows from the 
fact that >- is a term ordering, which implies that every ^-decreasing path 
must be finite. However, the only node from which the ^-decreasing path 
cannot be lengthened is x*. □ 

Checking for a given G C £ y whether there exists a ^-reduction path in 
G{J~c,b,G) for every b G Z" and for each pair x, y G J~c,b involves infinitely 
many situations that need to be checked. In fact, far fewer checks are needed: 
we only need to check for a ^-reduction path from x to y if there exists a 
^-critical path from x to y. 

Definition 5 Given G C £ y and b G Z n , a path (x,z,y) in G{J~c,b,G) is a 
^-critical path if z y x and z y y. 

If (x, z, y) is a ^-critical path in G{J~c,b, G), then x + u = z = y + v for some 
pair u,v G G, in which case, we call (x, z, y) a ^-critical path for (u, v) (see 
Figure 3). 



The following lemma will be a crucial ingredient in the correctness proofs 
of the algorithms presented in Section 3. It will guarantee correctness of the 
algorithm under consideration, since the necessary reduction paths have been 
constructed during the run of the algorithm. In the next lemma, we cannot 
assume that G is a generating set of £, since often this is what we are trying 
to construct. 

Lemma 6 Let x, y G Tc,b f or some b G I/ 1 , and let G C £ y where there is a 
path between x and y in G(J-c,b, G). If there exists a >- -reduction path between 
x' and y' for every y-critical path (x', z', y') in Q{Tc,bi G), then there exists a 
>~-reduction path between x and y in Q{J-c,b, G). 

Proof. Assume on the contrary that no such ^-reduction path exists from 
x to y. Among all paths ( k = y) in Q(Tc,b-,G) choose one such 

that max{x°, . . . , x k } is minimal. Such a minimal path exists since >- is a term 

ordering. Let j G {0, . . . , k} where x^ attains this maximum. 

By assumption, (x°, . . . , x k ) is not a ^-reduction path, and thus, x^ >- x° and 
x^ >- x k , and since x^ is maximal, we have x J >- x^~ l and x J >- Let 
u = x J —x^~ l and v = x J — x^ +1 . Then (x- 7 ' -1 , x- 7 , forms a ^-critical path. 




Fig. 3. A critical path for (u, v) between x, z, 



and y. 
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Consequently, we can replace the path (a;- 7-1 , x^ , x^ +1 ) with the >~- reduction 
path = x°, . . . ,x s = in the path (x°, . . . ,x k ) and obtain a new 

path between x and y with the property that the ^-maximum of the interme- 
diate nodes is strictly less than x j = maxjx 1 , . . . ,x k ~ 1 } (see Figure 4). This 
contradiction proves our claim. □ 




Fig. 4. Replacing a critical path by a reduction path 

The following corollary is a straight-forward consequence of Lemma 6, but 
nonetheless, it is worthwhile stating explicitly. 

Corollary 7 Let G C £ y . If for all b' G Z n and for every y -critical path 
(x',z',y') in G{J~c,v, G), there exists a ^--reduction path between x' and y' , 
then for all b G Z n and for all x, y G ^£,6 where x and y are connected in 
G{J~c,b,G), there exists a ^--reduction path between x and y in G{J~c,b->G). 

Combining Corollary 7 with Lemma 4, we arrive at the following result for 
Grobner bases. 

Corollary 8 A set G C £ y is a y-Grobner basis of £ if and only if G is a 
generating set of £ and if for all b G Z n and for every y -critical path (x, z, y) 
in G{J~c,b, G), there exists a y -reduction path between x and y in G{J~c,b, G). 

In Corollary 7 and Corollary 8, it is not necessary to check for a ^-reduction 
path from x to y for every ^-critical path (x,y,z) in G{J~c,b->G) for all b G 
Z n . Consider the case where there exists another ^-critical path (x',y',z') in 
Gi^Cb', G) for some b' G Z n such that (x, y, z) = (x' + 7, y' + 7, z' + 7) for 
some 7 G N n . Then, a ^-reduction path from x' to y' in Gi^cb', G) translates 
by 7 to a ^-reduction path from x to y in G{J~c,b-> G). Thus, we only need to 
check for a ^-reduction path from x' to y' . 

A ^-critical path (x, y, z) is minimal if there does not exist another ^-critical 
path (x', y', z') such that (x, y, z) = (x'+7, y'+7, z'+t) for some 7 G N n where 
7 7^ 0, or equivalently, min{xj,?/j, Zj} = for alH = 1, . . . , n. Consequently, 
if there exists a ^-reduction path between x and y for all minimal ^-critical 
paths (x, y, z), then there exists a ^-reduction path between x' and y' for all 
^-critical paths (x 1 , y', z'). Also, for each pair of vectors u, v G £, there exists 
a unique minimal ^-critical path [x^ u,v \z^ u,v \y^ u,v ^) determined by z^ u,v ^ : = 
max{-u + ,f + } component-wise, x^^ := z^ u ' v ^ —u andy^ u ' v ^ := z^^—v. So, any 
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other ^-critical path for (u, v) is of the form (x^'^ + 7, z^ w ' v ^ + 7, y( u > v ) + 7) for 
some 7 6 N". Using minimal ^-critical paths, we can rewrite Corollary 7 and 
Corollary 8, so that we only need to check for a finite number of ^-reduction 
paths. 

Lemma 9 Let G C Cy. If there exists a > — reduction path between x^ w ' v ' and 
y(«.«) j or ever y pair u,v £ G, then for all b £ Z n and for all x, y G Tc,b where 
x and y are connected in Q(J r c,b,G), there exists a y-reduction path between 
x and y in Q{Tc,b-> G) 

Corollary 10 A set G C £ y is a > — Grobner basis of C if and only if G is a 
generating set of C and for each pairu,v G G, there exists a > — reduction path 
between x^ u,v ^ and y( u ' v *> in Q(J r c, z ( u - v h G). 

We now turn Lemma 9 into an algorithmic tool. The following alg orithm, 
Algorithm 2 below, called a completion procedure ( Buchbergerl . Il987l ). guar- 



antees that if for a set S C £ the points x and y are connected in G(^Fc,x, S), 
then there exists a ^-reduction path between x and y in Q{J-c,x-, G), where G 
denotes the set returned by the completion procedure. Thus, if S is a gener- 
ating set of C, then Algorithm 2 returns a set G that is a ^-Grobner basis of 
C by Corollary 10. 

Given a set S C C, the completion procedure first sets G := S and then 
directs all vectors in G according to y such that G C £ y . Note that at this 
point G(J r c,b,S) = Q{J-c,b-,G) for all b G Z n . The completion procedure then 
determines whether the set G satisfies Lemma 9; in other words, it tries to 
find a reduction path from x^ u ' v ^ to y^^ for every pair u, v G G. If G satisfies 
Lemma 9, then we are done. Otherwise, no ^-reduction path was found for 
some (u, v), in which case, we add a vector to G so that a ^-reduction path 
exists, and then again, test whether G satisfies Lemma 9, and so on. 

To check for a ^-reduction path, using the "Normal Form Algorithm" , Algo- 
rithm 1 below, we construct a maximal ^-decreasing path in Q(J r c z ( u ,v),G) 
from x( u ' v ) to some x', and a maximal y- decreasing path in Q(!F Cz (u,v),G) 
from y( u ' v "> to some y' . If x' = y', then we have found a ^-reduction path from 
x \u,v) ^ Q y(u,v)_ Otherwise, we add the vector r G C y to G where r := x' — y' 
if x' y y', and r := y' — x' otherwise, so therefore, there is now a ^-reduction 
path from x^ u ' v > to y^ u ^ in Q (J-£ Z (u,v) , G) . Note that before we add r to G, 
since the paths from x to x' and from y to y' are maximal, there does not exist 
u G G such that x' > -u + or ?/' > u + . Therefore, there does not exist u G G 
such that r + > w + . This condition is needed to ensure that the completion 
procedure terminates. 

Algorithm 1 Normal Form Algorithm 

Input: a vector x G N n and a set G C C y . 
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Output: a vector x' where there is a maximal > — decreasing path from x to x' 
in G(Fc, x ,G). 
x' := x 

while there is some u G G such that u + < x' do 



x' := x' — u 



return x 1 

We write AfF(x, G) for the output of the Normal Form Algorithm. 
Algorithm 2 Completion procedure 
Input: a term ordering y and a set SQL. 

Output: a set G C £ y such that if x,y are connected in Q{Tc,x-, S), then there 
exists a > — reduction path between x and y in G{^c,x,G). 

G := {u : u + y u~ , u G S} U {— u : u~ y u + , u <E S} 
C := {(u, v) : u, v 6 G} 
while C 4^ do 

Select (u, v) G C 

C:=C\{(u,v)} 

r := AfF(x( u > v \G) - AfF(y^ v \ G) 
if r 7^ then 

if r~ y r + then r := —r 

C:=CU{{r,s) :seG} 

G:=GU{r} 

return G. 

We write CV(y, S) for the output of the Completion Procedure. 

Lemma 11 Algorithm 2 terminates and satisfies its specifications. 

Proof. Let (r 1 , r 2 , . . . ) be the sequence of vectors r that are added to the set 
G during the Algorithm 2. Since before we add r to G, there does not exist 
u G G such that r + > u + , the sequence satisfies r t+ r J+ whenev er i < j. 
By the Gordan-Dickson Lemma (see for example Cox et al. ( 1992| )). such a 



sequence must be finite and thus, Algorithm 2 must terminate. 

When the algorithm terminates, the set G must satisfy the property that 
for each u,v G G, there exists a ^-reduction path from x^ u ' v ^ to y^*^, and 
therefore, by Lemma 9, there exists a ^-reduction path between x and y in 
G{.^c,b,G) for all x, y G Tc,b f° r & U b G Z n where x and y are connected in 
G{J~c,bi G). Moreover, by construction, S C GU — G, and therefore, if x and y 
are connected in G(Tc,b, S), then x and y are connected in G{^Fc,b, G). □ 
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Note that the completion procedure preserves connectivity: given x, y G Tc,b 
for some b G Z n , if x and y are connected in G(^Fc,b, S), then x and y are also 
connected in G(^Fc,b, G). 



3 Computing a generating set 



In this section, we finally present three algorithms to co mpute a generating set 
of C: t he "Saturation" algorithm (Hosten and Sturmfels Hosten and Sturmfelsl 
( 199 51)), the "Lift-a nd- Project" algorithm (Bigatti, LaScala, and Robbiano 



Bigatti et al. (|l999l )). and our new "Project-and-Lift" algorithm. Each algc 



rithm produces a generating set of £ that is not necessarily minimal, and so, 
once a generating set of L is known, a minimal gener ating set of £ c an be 



Caboara et all f|2003h 



computed by a single Grobner basis computation (see 
for more details). The fundamental idea behind all three algorithms is essen- 
tially the same, and the main algorithmic building block of the algorithms is 
the completion procedure. 



3.1 The "Saturation" algorithm 



Let x, y G J~c,b f° r some b G Z n , and let S C C. Observe that if x and y are 
connected in G(J~c,b, S), then x + 7 and y + 7 are connected in G(J~c,b, S) for 
any 7 G N n since we can just translate any path from x to y in G(J~£,biS) 
by 7 giving a path from x + 7 to y + 7 in G(Fc,b+7i S). However, it is not 
necessarily true that x + 7 and y + 7 are also connected for any 7 G Z n (7 
may be negative) where x + 7 > and y + 7 > 0. 

Given a set C £, the Saturation algorithm constructs a set T such that if 
x and y are connected in G{Fc,b-, S) for some b G Z n , then x + 7 and y + 7 
are connected in Gi^cfi, T) for any 7 G Z n where x + 7 > and y + 7 > 0. 
Importantly then, if S spans C, then T must be a generating set of C. This 
follows since if S spans £, then for all 6 6 Z n and for all x, y G ^£,6, there 
must exist a 7 G N n such that x + 7 and y + 7 are connected in G(^Fc,b,T), 
and hence, a; and y must also be connected in Gi^cfii T) from our assumption 
about T. 

For convenience, we need some new notation. Given x, y G N n , we define 2 Ay 
as the component-wise minimum of x and y - that is, (xAy)i = min{xj, y{\ for 
alH = 1, . . . , n. Also, given a C {1, . . . , n}, we define iA ff ?/as the component- 
wise minimum of x and y for the o components and otherwise - that is, 
(x A y)i = minjxj, y^} if i G a and (x A y), = otherwise. 
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Definition 12 Let a C {1, ... ,n}, and letS, T C £. The set T is a -saturated 

on S if and only if for all 6 G Z" and for all x, y G Tc,b where x and y are 
connected in G{J~c,b,S), the points x — 7 and y — 7 are also connected in 
G(Fc,b-y, T) where 7 = x A a y. 

So, when T is a-saturated on S, if x and y are connected in G(J~c,b, S), then 
re + 7 and y + 7 are connected in G(J~c,b, T) for any 7 G Z n (7 can be negative) 
where x + 7 > 0, w + 7 > 0, and supp(7) C a. Saturation is thus concerned 
with the connectivity of a set T in relation to the connectivity of another set 
S. Note that, by definition, a set S C £ is 0-saturated on itself. Also observe 
that if S spans £, then T C £ is {1, . . . , n}-saturated on S 1 if and only if T is 
a generating set of £. 

The fundamental idea behind the Saturation algorithm is given S,T C £ 
where T is cr-saturated on S for some a C {1, . . . , n}, we can compute a set 
T' that is a (a U {z})-saturated on S for any z G a. Therefore, given a set 
SCC that spans £, starting from a set T = S, which is 0-saturated on S, if 
we do this repeatedly for each i G {1, . . . , n}, we arrive at a set X" C £ that 
is {1, . . . , n}-saturated on S 1 and, therefore, a generating set of L. 

The following two lemmas are fundamental to the saturation algorithm. First, 
we extend the definition of reduction paths. Given (p G Q n , a path (x°, . . . , x k ) 
in G{Tcf,, G) is an (^-reduction path if for no j G {1, . . . , k — 1}, we have 
tpxi > (px° and tpx^ > tpx k . Also, we define e % to be the zth unit vector and 
e l = —e l . So, given b E Z n , the path (x°, . . . , x k ) C jFc f, is a e*-reduction path 
if > x° or x\ > x\ for j — 1, . . . , k — 1. 

Lemma 13 Let S,T C £ and i G {1, ...,n}. TTie set T is {i} -saturated on S 
if and only if for all b G Z n and /or a// x,y E Fc,b where x and y are connected 
in G{J-c,b, S), there exists a e 1 -reduction path from x to y in G{J~c,b->T). 

Proof. Let x, y G Tc,b fc> r some b G Z™ where x and y are connected in 
G(Fc,b, S) and let 7 = x A w y. 

Assume T is {i}-saturated on S, and so, x — 7 and y — 7 are connected in 
G{J~c,b-i-i T). Let (x — 7 = a; , . . . , x k = y — 7) be a path from x — 7 and y — 7 
in G(J r c,b--y, T). The path (x = x° + 7, . . . , x k + 7 = y) is a e*-reduction path 
from x to w in G(J I 'c,b,T). 

Conversely, by assumption, there exists a ^-reduction path ( 

y) in QiTcb-, T). The path (x — 7 = x° — 7, . . . , x k — 7 = w — 7) is thus a 

feasible path from x — 7 to w — 7 in G{J r c,b~-y, T). □ 

Given any vector ip G Q n and a term order -<, we define the order where 
x -i^ y \i Lpx < ipy or ipx = ipy and x ^ y. Since we assume £ fl N n = {0}, the 
order is thus a term ordering for £. Importantly then, a -^-reduction path 
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is also an e*-reduction path. Let T = CV{-<^, S). Then, by the properties of 
the completion procedure, for all b G Z n and x, y G J~c,,b where x and y 
are connected in G{J~c,b, S), there exists a -< g i-reduction path from x to y in 
G(^c,b,T); T is therefore {i}-saturated on 5. 

Let S,T C £ and T is cr-saturated on S for some cr C {l,...,n}. Let 
T" = CV(-<gi,T). So, T" is therefore {i}-saturated on T. For the saturation 
algorithm to work, we need that T' is also (cr U {i})-saturated on S, which 
follows from Lemma 14 below. 

Lemma 14 Let cr, r C {1, . . . , n} and S,T,U C £. // [/ a -saturated on S , 
and T is r -saturated on U , then T is (a U r)-saturated on S. 

Proof. Let b G Z n , and x,y & Tc,b where x and y are connected in G{J~c,b, S). 
Let a = x A a y. Since T is cr-saturated on S, x — a and y — a are connected 
in G(J-c,b-a,T). Let /3 = i- aA r i/-a. Then, since [/ is r-saturated on T, 
x — a — [3 and y — a — (3 are connected in G{J~c,b-a-(3-, U). Let 7 = a + /?; then, 
7 = x A( ctUt ) y. Therefore, there is a path from x — 7 to y — 7 in G{J~c,b--y, U) 
as required. □ 

We now arrive at the Saturation algorithm below. 

Algorithm 3 Saturation algorithm 

Input: a spanning set S of L. 
Output: a generating set G of C. 
G:=S 
a := 

while a ^ {1. .... n} do 

Select i G a 

G :=CPK-i,G9 

a := a U {z} 
return G. 

Lemma 15 Algorithm 3 terminates and satisfies its specifications. 

Proof. Algorithm 3 terminates, since Algorithm 2 always terminates. We show 
at the beginning of each iteration that G is cr-saturated on S, and so, at the end 
of the algorithm G is {1, ... , n}-saturated on S; therefore, G is a generating 
set of C. At the beginning of the first iteration, G is cr-saturated on S since 
cr = and G = S. So, we can assume it is true for the current iteration, 
and now, we show it is true for the next iteration. Let G' := CV{-<e^G). 
Then, by Lemma 13, G' is {i}-saturated on G, and so, by Lemma 14, G' is 
(cr U {i})-saturated on S. So, G is cr-saturated on S at the beginning of the 
next iteration. □ 
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During the Saturation algorithm, we saturate n times , once for each % G 
{l,...,n}. However, as proven in IHosten and Shapiro! ( 2000j ). it is in fact 



only necessary to perform at most |_§ J saturations. Given S,T C £, we can 
show that there always exists a a C {1, . . . , n} where \a\ < |_§J such that if 
T is cr-saturated on S, then T is {1, . . . , n}-saturated on S. The following two 
lemmas prove the result. 

Lemma 16 Let cr C {1, . . . , n} ; 5,TC£ where T is a -saturated on S , and 
u G S. If supp(u~) C a or supp(w + ) C a, then T is (supp(-u) U a)-saturated 
on S. 

Proof. Assume that supp(u~) C a. Let x,y G !Fc,b for some b G Z n where a; 
and y are connected in Q^cb, S). Let a = iA sup p(u+)?/ and /3 = i-aA ff ?/-a. 
We must show that x — a — (3 and y — a — (3 are connected in Q(J r c,b-a-i3, T) 
since a + [3 = x A( supp ( u +) Uo -) y. By translating the path from x to y by a, 
we get a path from x - a to i/ - a that is non-negative on all components 
except supp(w + ). This path can transformed into a path that is non- negative 
on all components except supp(-u~) by adding u to the start of the path as 
many times as necessary and subtracting u from the end of the path the 
same number of times. Therefore, x — a + 7 and y — a + 7 are connected in 
Q(J r c,b-a+'y, S) for so me 7 G N n where supp(7) C supp(-u~) C a. Observe that 
supp(,9 + 7) C a. Thus, since T is cr-saturated, x — a — (3 and y — a — (3 are 
connected in Q{? 'c,b-a~/3,T) as required. 

The case where T is supp(-u + ) C a is essentially the same as above. □ 

Lemma 17 Let S,T C £. There exists a a C {l,...,n} where \o~\ < |_fj 
sitc/i i/iat z/T is o-saturated on S, then T is {1, ... , n}-saturated on S. 

Proof. We show this by construction. Without loss of generality, we assume 
that £ is not contained in any of the linear subspaces {xj : £j = 0,x G M n } 
for i = 1, . . . , n; otherwise, we may simply delete this component. 

Let a = 0, r = 0, and £7 = 0. Repeat the following steps until r = {1, . . . , n}. 

(1) Select u E S such that supp(w) \ r 7^ 0. 

(2) If I supp(-u + ) \ t| > I supp(w _ ) \ t\, then cr := cr U supp(w^), else a : = 
er U supp(-u + ). 

(3) Set r := r U supp(w), and set U := U U {u}. 

The procedure must terminate since during each iteration we increase the size 
of r. Note that, at termination, U C S, {J u &u supp(it) = r = {1, . . . ,n}, and 
for all u G C/ either supp(-u + ) C a or supp(-u - ) C a. Therefore, by applying 
Lemma 16 recursively for each u G U, we have that if T is a-saturated on 5", 
then T is {1, . . . , n}-saturated on S. Lastly, since in each iteration we add at 
least twice as many components to r as to cr, we conclude that at termination 
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Example 18 Consider again the set S := {(1,-1,-1,-3,-1, 2), (1,0, 2,-2,-2,1)}. 
Let £ be the lattice spanned by S , and let a = {1,6}. Then, by Lemma 16, since 
supp((l,-l,-l,-3,-l,2)+) = {1,6} and supp((l,-l,-l,-3,-l,2)) = {1,2,3,4,5,6}, 
if a set T C £ is {1, 6}-saturated on S , then T is {1, 2, 3, 4, 5, Q}-saturated on 
S. So, to compute a generating set of £, we only need to saturate on {1, 6}. The 
following table gives the values of a, i, and G at each stage of the Saturation 
algorithm when constructing a set that is {1,6} -saturated on S, and hence, a 
generating set of £. 



a 


i 


G ;=CV{< E i,G) 





1 


{(-1,0,-2,2,2,-1) (-1,1,1,3,1,-2) (-1,2,4,4,0,-3) (0,-1,-3,-1,1,1)} 


{1} 


6 


{(0,1,3,1,-1,-1), (-1,1,1,3,1,-2), (-1,0,-2,2,2,-1), (-1,-1,-5,1,3,0), (1,2,8,0,-4,-1)} 



Observe that after the first iteration, that G is not a generating set of £. The 
set G does not contain the vector (-1,-1,-5,1,3,0), and so, the graph Q[Tc,b^ G) 
where b = (0,0,0,1,3,0) is disconnected. Note that the final set G is not 
a minimal generatin g set of £; the vector (1,2,8,0,-4,-1) is not needed. See 
Caboara et al\ $2003) for an algorithm to compute a minimal generating set. 



We now introduce the concept of a cr-generating set of £ for some a C 
{l,...,n} - a generalization of a generating set of £. These new generat- 
ing sets provide useful insights into saturation and the inspiration for the 
Project-and-Lift algorithm as well as a point of reference to compare the two 
algorithms. 

Firstly, we define T a Ch := {z : z = b (mod £),z 9 > 0,z G Z n } where a C 
{1, . . . , n}, so we now allow the a components to be negative. Given S C C, 
analogous to QiTcjo, S), we define QiT^^ S) to be the undirected graph with 
nodes b and edges (x, y) if x — y G S or y — x G S. Observe that a path 
in Qi^cbi^) i s non-negative on the a components and may be negative on 
the a components. Analogous to a generating set of C, a set S C C is a cr- 
generating set of £ if the graph G{Fci,S) is connected for every b G Z n . 
Note that 0-generating sets are equivalent to generating sets and {1, . . . , re- 
generating sets are equivalent to spanning sets. 

Lemma 19 Let a C {1, . . . , n} and S,T C £ where S spans £. If T is a- 
saturated on S, then T is a a-generating set of £. 

Proof. Let x,y G J-£ b for some b G Z n . We must show that x and y are 
connected in Q{T a Ch , S). Since S spans £, there must exist a 7 G N n such that 
x + 7 and y + 7 are connected in Q(J r c,b+i^ Let a, ft G N n where a + ft = 7, 
supp(a;) C cr, and supp(/3) C a. Since T is cx-saturated on S and supp(a) C a, 
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the points x+j3 = x+j — a and y+(3 = y+j — a are connected in Q(J-'c,b+P^ 
Therefore, since supp(/3) C a, x and y are connected in Q{T a n h , S). □ 

Interestingly, the converse of Lemma 19 is not true in general: a a-generating 
set is not necessarily a cr-saturated set. Let S, T C C where S spans C, a C 
{1, . . . , n}, and let x, y G Tc,b f° r some b G Z n where x and t/ are connected in 
Q{^c,b-, S). If T is a cr-generating set of £, then x — 7 and y — 7 are connected 
in Q \Tc,o i6 _ 7 , T) where 7 = x A CT t/. In other words, there is a path from x — 7 
and 1/ — 7 that remains non- negative on the a components but may be negative 
on the a components. On the other hand, if T is a-saturated on S, then x — 7 
and y — 7 are connected in Q(J r c,b--y,T) where again 7 = x A a y. In other 
words, there is a path from x — 7 and y — 7 that remains non-negative on 
a// the components. So, while a-generating sets, like a-saturated sets, ensure 
path non-negativity on the a components, they do not preserve existing path 
non- negativity on the other a components like a-saturated sets do. Indeed, 
a-generating sets say nothing at all about the path non-negativity of the a 
components. So, a-saturation is a stronger concept than a-generation. 

In the Project-and-Lift algorithm, we compute a-generating sets instead of 
cr-saturated sets. By doing so, we can effectively ignore the a components, 
and therefore, we compute smaller intermediate sets, although we start and 
finish at the same point. 

3.2 The "Project-and-Lift" algorithm 

Given a C {l,...,n}, we define the projective map ix G : 7L n ^ Zl*l that 
projects a vector in U 1 onto the a = {1, . . . ,n}\a components. For conve- 
nience, we write C a where a C {1, ... ,71} as the projection of C onto the a 
components - that is, C a = ir a (£). Note that C a is also a lattice. 

The fundamental idea behind the Project-and-Lift algorithm is that using a 
set S C £W that is a generating set of for some i G {1, . . . ,n}, we can 
compute a set S' C £W such that S' lifts to a generating set of C. So, for 
some a C {1, . . . , n}, since C a is also a lattice, starting with a generating set 
of we can compute a generating of f or some i e a. So, by doing this 

repeatedly for every i G cr, we attain a generating set of £. 

First, we extend the definition of Grobner bases. Given (p G Q™, recall that a 
path . . . , x fc ) in Q[Tc,b-, G) is a (^-reduction path if for no j G {1, . . . , k— 1}, 
we have y?^ > and (^x 7 > y?^. A set G C C is a (/9-Grobner basis of C 
if for all b G Z n and for every pair x,y <E J^cb, there exists a (^-reduction path 
from x to y in Q{Tc,b-, G). 

The following lemma is fundamental to the Project-and-Lift algorithm. Note 
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that the property that ker(7T{j}) DC— {0} for some i G {1, . . . , n} means that 
each vector in lifts to a unique vector in C, and thus, the inverse map 
7T|^| : i — ► C is well-defined. Moreover, by linear algebra, there must exist 
a vector a/ G Q n-1 such that for all u G we have ofu = (n^(u))i. We 

will always write such a vector as u/, and also, we define uj % = —u> % . 

Lemma 20 Let i G {1, . . . ,n} where ker(7T{j}) DC— {0}, and let S C £W. 
T/ie sei S is a uj % -Grobner basis of if and only if tt^(S) is a e l -Grdbner 
basis of C. 

Proof. Assume S is a c</-Gr6bner basis of C^. Let x,y G Tc,b for some 
6 G Z". We need to show that there is a e*-reduction path from x to y in 
£(-7 r £,&,7r {i }(<S'))- Let x = 7r w (x), t/ = 7T W (y), and b = n {i} (b). By assumption, 

there exists a ^-reduction path (x = x°, . . . , x k = y) in G^c^fii So, we 
have ufxi > u/x or u/x J > u l y for all j. We now lift this o)*-reduction path in 
Q{T C {i}- h , S) to a ^-reduction path in G(Fc,b, 7r {i}(5'))- 

Let x J = x + Tr^jtx- 7 — x) = y + n^{x^ — y) for all j = 0, . . . , k. Hence, 
^{i}^) = & and x\ = Xi + ufx? — u l x = yi + uj 1 x^ — i>j % y, and so, x\ > Xj 
or x{ > yi. Also, x J — x J_1 = 7r7a(x J — x 5-1 ) G 7r^J (5') for all j = 1, . . . , k. 

Therefore, (x = x°, . . . , y k = y) is an ^-reduction path in Q[Tc,b, ^^(S)) as 
required. 

Assume tt^(S) is a e l -Grobner basis of C Let x,y G Fc^,b f° r some 6 G Z n_1 , 
and let 7 = cu l (x — y). If 7 > 0, then let x = (x, 7) and y = (y,0), else let 

x = (x, 0) and y = (y, —7); hence, x,y G ^5 for some 6 G Z n , and = b, 
7T{j}(a;) = x, vr{j}(|/) = y, and min{xj,f/j} = 0. By assumption, there exists a 
^-reduction path (x = x°, . . . , x k = y) in Gi^cb^^i^))- Let x J = ^{^(x- 7 ). 
So, (x = x°, . . . , x k = y) is a path in G{J~cW b-> S). Moreover, since x\ > Xj or 

xi > Vi for all j, we have u/x J > ufx or u/x J > u/y for all j. Therefore, the 
path is a a/-reduction path. □ 

By definition, a e*-Grobner basis of C is also a generating set of C On the 
other hand, a generating set of £ is also a e^Grobner basis of C This follows 
since, given a generating set of £, for any x,y <E Tc,b for any b, there must 
exist a path from x — 7 to y — 7 where 7 = x y, and by translating such 
a path by 7, we get a e*-reduction path from x to This can also be shown 
using Lemma 13. So, we arrive at the following corollary. 

Corollary 21 Let i G {1, . . . ,n} where ker(7T{j}) DC— {0}, and let S C £W. 
T/ie sei S is a <Jj l -Grobner basis of if and only if tt^(S) is a generating 
set of C. 

Given a vector tp G Q n , any ^-reduction path is also a ^-reduction path, and 
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so, any -<^-Gr6bner basis is also a (^-Grobner basis. So, given a set S C £W 
that generates , we can compute a u>*-Grobner basis S' C £W of £W by 
running the completion procedure with respect to on S. That is, S" = 
CP(-<Qi,S). Hence, by Lemma 20, n^(S') is a generating set of C. 

We can apply the above reasoning to compute a generating set of from 
a generating set of C a for some cr C {1, . . . ,n} and i G (7. First, analogously 
to 7T{j} and -^i in the context of £^ and £, we define 7Tm and in the 
same way except in the context of C u and respectively. 

We can now present our Project-and-Lift algorithm. 

Algorithm 4 Project-and-Lift algorithm 

Input: a set S C £ £/ia£ spans £. 
Output: a generating G set of C 

Find a set a C {1, ... ,n} sncn too* ker(7r CT ) n £ = {0} and £ CT nN |s| = {0}. 
Compute a set G C £°" s^cn taat G is a generating set of C a using S. 
while a do 
Select i e cr 

Cr := Cr\ {*} 

return G. 



Lemma 22 Algorithm 4 terminates and satisfies its specifications. 

Proof. Algorithm 4 terminates, since Algorithm 2 always terminates. 

We claim that for each iteration of the algorithm, G is a generating set of 
C a , ker(7r (T ) n C = {0}, and C a n = {0}; therefore, at termination, G is a 
generating set of C. This is true for the first iteration, so we assume it is true 
for the current iteration. 

If a = 0, then there is nothing left to do, so assume otherwise. Since by 
assumption, £ ff nN' ff ' = {0} and ker(7r CT ) n£ CT = {0}, we must have ker(7T/ i i) H 
£°"\W — jo}, and so, the inverse map (^m) -1 : ^ ~ *■ C a ^ 1 ^ is well-defined. 
Let iea, G' : = (7if i} ) _1 (CP(^f i} , G)), and a' := a \ {i}. Then, by Corollary 
21, G' is a generating set of C a ' . Also, since a' C cr, we must have ker(7r CT /)n£ = 
{0} and C 7 ' n N 15 ' 1 = {0}. Thus, the claim is true for the next iteration. □ 

In our Project-and-Lift algorithm, we need to find a set a C jl, . . . , n} such 
that ker(7r cr ) n C a = {0} and C u fl N'°"' = {0}, and then, we need to compute 
a generating set of C a . 
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For our purposes, the larger a the better. However, in general, finding the 
largest a is difficult; thus, we use the following method for finding a good 
a. Let B be a basis for the lattice £ (C is spanned by the rows of B). Let 
k := rank(5). Any k linearly independent columns of B then suffice to give 
a set a such that every vector in C a lifts to a unique vector in C; that is, 
ker(7r CT ) PI C a = {0}. Such a set a can be found via Gaussian elimination. If 
m#l + {0}, then remove some i E a from a (a := a \ {i}) and recompute 
O 7 n N 1 * 1 . Continue to do so until C a n N l<f| = {0}. This procedure must 
terminate since C fl W 1 = {0} by assumption. To check if C a fl N' "' = {0}, we 
can either solve a linear progr amming problem or com p ute the extreme rays 
of C a f l Mj^j (see f o r exam ple lAvis and Fukuda ( 1996J ) ; Fukuda and Pro don 



( 1996f ): Hemmecke (12002^. In practice, we compute extreme rays using the 



algorithm in iHemmeckd (J2Q02) . 

Once we have found such a a, we can compute a generating set of C a using 
either the Saturation algorithm, the Min-Max algorithm, or any other such 
algorithm. In practice and for this paper, we use the Saturation algorithm. 
It is possible that there does not exist such a a except the trivial case where 
a = 0, and so, the Project-and-Lift algorithm reduces to just the initial phase 
of computing a generating set of £ using some other algorithm. Though in 
practice, we usually found a non-trivial a. We refer the reader to Section 4 
for a description of a complete Project-and-Lift algorithm whereby we do not 
need another algorithm to start with. 

Example 23 Consider again the set S := {(1,-1,-1,-3,-1,2), (1,0,2,-2,-2,1)}. 
Let C be the lattice spanned by S . Let a ={3,4,5,6}. Then, ker(7r cr ) nC a = {0}. 
Note thatn a {S) ={(1,-1), (1,0)}. However, £ CT nJ#1 ^ {0}. So, seta = {3,4,6}. 
Now TT a (S) ={(1,-1,-1), (1,0,-2)}, and C a n = {0}. 

The set G ={(0,-1,1), (-1,2,0)} is a generating set of C a . We can compute this 
using the saturation algorithm. The following table gives the values of a, i, u l , 
and G at each stage of the Project-and-Lift algorithm. 



a 


i 






G:= (vr^r^K^)) 


{3,4,6} 


3 


(2,3,0) 


{(0,-l,l),(l,-2,0)} 


{(0,-l,-3,l),(l,-2,-4,0)} 


{4,6} 


4 


(-2,1,0,0) 


{(0,-l,-3,l),(l,-2,-4,0)} 


{(0,-l,-3,-l,l),(l,-2,-4,-4,0)} 


{6} 


6 


(1,-1,0,0,0) 


{(0,1,3,1,-1), (-1,1,1,3,1), 
(-1,0,-2,2,2), (-1,-1,-5,1,3), 
( 1,2,8,0,-4)} 


{(0,1,3,1,-1,-1), (-1,1,1,3,1,-2), 
(-1,0,-2,2,2,-1), (-1,-1,-5,1,3,0), 
( 1,2,8,0,-4,-1)} 



The final G is a generating set of C Again note that it is not minimal; the 
vector (1,2,8,0,-4,-1) is not needed and can be removed from G, and G will 
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still be a generating set of £. 



The concepts of cr-generating sets of £ and generating sets of £ a are, in 
fact, equivalent. So, as discussed before, unlike that Saturation algorithm, 
the Project-and-Lift algorithm computes cr-generating sets and thus does less 
work than the Saturation algorithm. 

Lemma 24 Let a C {1, . . . , n} where ker(7r CT ) n £ = {0} and S C £ a . The 

set S is a generating set of £ a if and only ifir~ l (S) is a a -generating set of 
£. 

Proof. Recall that a cr-generating set of £ is a set where for all for all 6 6 Z" 
and for all x, y G J-£ b , there exists a path from x to y in Q{J-^ b: S). Observe 
that ^a(^cb) = Fc° ,-K a (b)i and moreover, a path in G{J~£b,S) projects to a 
path in G(J r c 7 ,n <7 (b), S). Hence, a cr-generating set of £ projects to a generating 
set of £ a . So, if S is a cr-generating set of £, then n a (S) is a generating set 
of £° ' . Also, assuming ker(7r CT ) D £ — {0}, if S is a generating set of £ CT , then 
7r o r 1 (S') is a cr-generating set of £. This follows since a path in Q{Tc £) can 
be lifted to a path in QiT^i, S) where TT a (b) — b. □ 

Observe that if ker(7r (T ) n £ ^ {0}, then a path in Q{Tc a ,b-, ^^iS)) cannot 
necessarily be lifted to a path in ^(JF^ 5 , 7r o r 1 (S')) - the path may become 
disconnected - although, we can easily rectify this by adding a spanning set 
of the lattice ker(7r cr ) PI £ to 7r~ 1 (S'). 

The Project-and-Lift algorithm has some interesting properties. As we saw in 
Lemma 20, a>*-reduction paths lift to e*-reduction paths and e*-reduction paths 
project to o)*-reduction paths. The same holds true for -< Q i -reduction paths 
and -^-reduction paths, shown in exactly the same way, giving the following 
lemma. 

Lemma 25 Let i 6 {1, . . . , n} where ker(7T{j}) R £ = {0} ; and let S C £W. 

Let -< be a term order. The set 7r7A(S) is a -< S i-Grobner basis of £ if and only 
if S is a ~< Q i-Grdbner basis of £^ . 

So, during the Project-and-Lift algorithm, we compute a ^i-Grobner basis 
for some i and then lift it to a -^-Grobner basis. We then compute a -K^- 
Grobner basis using some j ^ i and again lift it to a -^Grobner basis, and 
repeat. So effectively, the Project-and-Lift algorithm just converts one Grobner 
basis into another and lifts to another Grobner basis. We therefore could use 
a Grobner walk algorithm to move from one Grobner basis to another (see 
Gollart et all (|l997h : lj%kuda et alJlfeOOfih ). We have not yet implemented such 



an algorithm. It would be interesting to see its performance. 

There are, in fact, two essentially equivalent ways to compute a -^-Grobner 
basis of £ from a set S C £W that generates £^ for some % E {1, . . . , n} where 
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ker("7T{j}) fl C = {0}, as needed by the Project-and-Lift algorithm. Firstly, as 
we have already seen, the set T = ttZUCV^w^ S)) is a -< g i-Grobner basis of 
C, but also, the set T' = CV(^ S i,ir7}(S)) is also a -< g ;-Gr6bner basis of C. 
Essentially, to compute a -< gl -Grobner basis of £, we do not need a generating 
set of £, but instead, we only need a {i}-generating set of C. This follows from 
the following Lemmas, which are analogous to Lemmas 20 and 25 respectively. 



Lemma 26 Let i G {1, . . . ,n} where ker(7T{j}) fl C = {0}, and let S, T C C 
where S is a {%] -generating set of C. The set T is a e 1 -Grobner basis of £ if 
and only if for all b G Z n and for all x, y G J~c,b where x and y are connected 
in Q{Tc.f>i S), there exists an e % -reduction path from x to y in G{J~c,bi T). 

Proof. The forwards direction must hold by definition. Conversely, let x, y G 
J-cjb f° r some b G Z n . Since S is a {i}-generating set of C, there must exist 
7 G N n where supp(7) C {i}, such that x + 7 is connected to y + 7 in 
G{J~c,b+T> ^ assumption, there exists an e*-reduction path from x + 7 

to y + 7 in ^(^£,6+ 7 , T), which translates to a path from x to y in G{J~c,bi T) 
since supp(7) C {i}. □ 

An analogous results holds for ^ g ;-Gr6bner bases for similar reasons. 

Lemma 27 Let i G {1, . . . ,n} where ker(7T{j}) fl C = {0} ; and let S,T C £ 
where S is a {i}- generating set of C The set T is a -< E i-Grdbner basis of £ if 
and only if for all b G Z n and for all x, y G JFc b where x and y are connected 
in G{J-c,b, S), there exists an -reduction path from x to y in G{Fc b ,T). 

Therefore, if S C £W generates C^, then nZUS) is a {^-generating set of C 
by Lemma 24. So, the set T' = CVi^^i 7r m('S')) i s a -<g i_ Gr6bner basis of £. 
Moreover, when computing CV(~<yji, S) and computing CP(-< g i, vr^j(S')), the 
completion procedure performs essentially the same sequence of steps produc- 
ing essentially the same output data and intermediate data with the exception 
that they perform the computation in different spaces. These two approaches 
are thus algorithmically equivalent. 

In one iteration, the Saturation algorithm computes CP(^ g i,T), in the space 
C, for some set T C C that is a-saturated on some spanning set for some 
a C {1, ... ,71} and i G a. On the other hand, in one iteration, the Project- 
and-Lift effectively computes, in the space C a ^' l \ CP(^ g i,T) for some set 
T C that is a {ij-generating set of C a for some a C {1, . . . ,n} and 

% G a. So, the algorithms are very similar, but the Project-and-Lift algorithm 
performs intermediate steps in subspaces whereas the Saturation algorithm 
performs intermediate steps in the original space. 
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3.3 The "Lift-and-Project" algorithm 



The idea behind this algorithm is to lift a spanning set S of C C Z n to a 
spanning set S" C Z n+1 of £' C Z n+1 in such a way that we can compute a set 
G' C £' that generates £' in only one saturation step. Then, we project G' to 
G C £, so that G is a generating set of £ 

Let S be a spanning set of C C Z n . Let 5' := {(u,0) : m G 5}U{(1, . ..,1,-1)}, 
and let £ C Z n+1 be the lattice spanned by 5". Since the vector (1, . . . , 1, — 1) 
is in S', it follows from Lemma 16, that if a set G 1 C £' is {n + l}-saturated 
on 5", then G' is {1, . . . , n + l}-saturated on S 1 , and hence, G' is a generating 
set of £. Also, since £ n N n = {0}, then £ n Z™ +1 = {0}. Now, using exactly 
the same idea behind the Saturation algorithm, if we let G' := CP(^ e -n+i, S"), 
then G' must be a generating set for the lattice £ by Lemma 13. 

So, at the moment, we have a generating set G' for £, and from this, we need 
to extract a generating set of £ We define the linear map p : Z n+1 i— > Z n 
where 

p(u') := (u[ + u' n+1 ,u' 2 + u' n+1 ,...,u' n + u' n+1 ). 

Observe that p maps Z" +1 onto Z™, maps onto £, and maps J-c,v onto 
6 where b = p(b'). Let G := {p(m') : w' G G"} \ {0}. So, G C £, and we now 
show that in fact G generates £. Let ( path in Q{Tap, G'). 

Then, (p(x'°), . . . , p(x' k )) is a walk from p(x'°) to p(x' h ) in Q{J r c,p(b),G), so 
after removing cycles, we have a path from p(x'°) to p{x' k ). Cycles may exist 
because the kernel of p is non-trivial - ker(p) = {(7, . . . , 7, —7) : 7 G Z}. Let 
x,y G Tc,b fo r some 6 G Z™, and let x' := (x, 0), := (y, 0), and 6' := (6,0); 
hence, p(x') = x, p(y') = y, and p(fe') = b. Then, since G' is a generating set 
of £ there must exist a path from x' to y' in Q(J r c , ,b', G'), and therefore, there 
exists a path from x to y in G(Fc,b, G). Hence, G is a generating set of £ We 
thus arrive at the Lift-and-Project algorithm. 

Algorithm 5 Lift-and-Project algorithm 

Input: a set S C C that spans £ 
Output: a generating set G of L 

S':={( U ,0):«eS}U{(l,...,l,-l)} 

a :=cv(^ n+1 ,s r ) 

G := {p{u') : v! G G'} \ {0} 
return G. 

To make the algorithm more efficient, we can use a different additional vector 
to (1, . . . , 1, — 1). By Lemma 17, we know that given a spanning set S, there 
exists a a where \a\ < |_f J such that if T is cr-saturated on S, then T is 
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a generating set of C Then, instead of (1, . . . , 1, — 1), it suffices to use the 
additional vector s a = Yliea e% ~ e n+1 , which has the important property that 
supp(s+) = a and supp(s~) = {n + 1}. Recall that e l is the ith unit vector. 
Set S' := {(u, 0) : u G S} U {s a }, and let CJ be the lattice spanned by 5". 
Then, from Lemma 16, since s a G S', if a set G' C £' is {n + l}-saturated on 
5", then G' is (cr U {n + l})-saturated on S'. Also, since {(u, 0) : u G S*} C S", 
from the proof of Lemma 17, it follows that if G' is cr-saturated on S", then G' 
is {1, . . . , n}-saturated. Hence, G' is {1, . . . , n + l}-saturated, and therefore, 
a generating set of £ . So again, we can compute a generating set G' of £ in 
one saturation step. Also, we similarly define the linear map p a : Z n+1 i— > Z n 
where p a (x') := (x^x'a, ...,x' n ) + (J2iea e d x n+l- Then, G := {p (T (x / ) : x' G G"} 
is a generating set of C. As a general rule, the smaller the size of cr, the faster 
the algorithm. 



4 What if £ n N n ^ {0}? 



If C n N n 7^ {0}, then computing a generating set of the lattice C is actually 
more straight-forward than otherwise. The vectors in L D N n are very useful 
when constructing generating sets. 

We say that component i G {1, . . . ,n} is unbounded if there exists a u G 
£nN" where i G supp(w) and bounded otherwise. ^From Farkas' lemma, i 
is unbounded if and only if the linear program max{xj : x = (mod C), x G 
M"} is unbounded. To find a w G C such that it > and i G supp(-u), and 
so also, to check whether % is unbounded, we can solve a linear program o r 
compute the extreme rays o f ^nN 11 (see for exa mple Avis and Fukudal |l996): 



Fukuda and Prodou (|l996i ): lHemmeckel (|2002h ). Given a term order -< of C 



the order -< S t is a term order if and only if i is bounded. 

Using the following lemma, we can extend the Saturation algorithm to the 
more general case where £ fl N n ^ {0}. 

Lemma 28 Let S C C. If there exists u G S where u G C fl W 1 and it ^ 0, 
then S is supp(w) -saturated (on S). 

Proof. By definition, S is 0-saturated (on S). Since u > 0, we have supp(-u~) = 
0, and so it follows immediately from Lemma 16 that S is supp(ti)-saturated 
(on S). □ 

We can now extend the Saturation algorithm. Let r C {1, . . . , n} be the set of 
unbounded components, and let S be a spanning set of £. Then, for each i G r, 
find a a 6 £ such that w > and ttj > and add it to S. Or equivalently, 
find a single w > such that supp(w) = r and add it to S 1 . Now S is r- 
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saturated (on S) by Lemma 28. So, if a set T is f-saturated on S, then T is 
{1, . . . , n}-saturated on S by Lemma 14, and so, T is a generating set of C. So, 
we iteratively compute T := CP(-<gi, T) for every i e f; then, T is f-saturated 
on S as required. 

The Project-and-Lift algorithm can also be extended to the more general case 
where £ fl N n ^ {0}. First, we need the following lemma. 

Lemma 29 Let a C {1, . . . , n}, S C C, and u G C n N n and u ^ 0. // S is a 
a-generating set of C and u G S, then S is a (er \ supp (w)) -generating set of 
C. 

Proof. Let x, y G ^£,6 for some 6 G Z n . Since 5 is a ^-generating set of £, 
there exists a path from x to y in G{J~c,b-> This path can transformed into 
a path in £( i 7^ < ^ supp(u - ) - ) , S) by adding -u to the start of the path as many times 
as necessary and subtracting u from the end of the path the same number of 
times. □ 

Let a C {1, . . . , n} where ker(7r cr ) fl Cf = {0}. Let S C Cf where S is a gener- 
ating set of C a . Also, let i & a. We now show how to construct a generating 
set of C a \{ l \ and thus by induction, a generating set of C. Firstly, since S is 
a generating set of tc^(S) is a {i}-generating of from Lemma 24. 

If % is unbounded for then there exists a u E 

£ U \W suc h that u > 

and -Uj > 0. Thus, after adding u to (7r| i |) _1 (S'), we then have a generating set 
of C a \ {i} . If z is bounded, then compute S := CV(-< i,S), and (tt^) - ^^ is 
then a generating set of C a ^. 

We first need to find an initial a and S such that ker(7r cr ) fl L a = {0} and 5 1 is 
a generating set of C° '. Let _B be a lattice basis of C where the rows of B span 
C. Let a be any rank(i?) linearly independent columns of B. Let S = 7r a (B). 
Then, every vector in C a lifts to a unique vector in C. Then, computing a 
u G C a such that if > can be done by Gaussian elimination. After adding u 
to S, S is a generating set of £ CT as required. 

We can also extend the Lift- and- Project algorithm in a similar way. As above, 
we can find a set S such that S is r-saturated (on S). The set 

S' :={(u,0):ueS}U{^-e n+1 } 

is also r-saturated (on S') for the same reasons. If a set T' C £' is {n + 1}- 
saturated on S", then T' is (f U{n + l})-saturated on S' by Lemma 28, and so, 
by Lemma 14, T' is {1, ...,n + l}-saturated on S' since 6" is r-saturated (on 
S'); thus, T' is then a generating set of £'. Hence, in one saturation step, we 
can compute a generating set of Note that the component n + 1 is bounded 
by construction. Then, the set T := {p f (u') : u' G T'} is a generating set of £. 
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5 Speeding-up the Completion Procedure 



Finally, before presenting computational experience, we talk about ways in 
which the key algorithm, Algorithm 2, can be improved. This leads us to the 
critical pair criteria. 

Algorithm 2 has to test for a reduction path between x^'^ and y( u > v ^ for all 
critical pairs C := {(u, v) : u,v G G}. In the case of lattice ideals, com- 
putational profiling shows that this is the most time consuming part of the 
computation. So, we wish to reduce the number of critical pairs that we test, 
and avoid this expensive test as often as possible. We present three criteria 
that can reduce the number of critical pairs that need to be tested. 



Criteria 1 and 3 (see iBuchberger (|l979l Il98fih : iGebauer and Mollerl 



are translated from the theory of Grobner bases into a geometric context. 
Criterion 2 is specific to lattic e ideals and corresponds to us i ng th e homo- 
geneous Buchbererer algorithm (|Caboara et all Eiol iTraversol . Il997h . but we 
give a slightly more general result. Note that all three criteria can be applied 
simultaneously. 



Criterion 1: The Disjoint-Positive-Support criterion 

For a pair u,v G G, the Disjoint-Positive-Support criterion is a simple and 
quick test for a ^-reduction path from x^ u,v ' to y( u ' v \ So, using this quick test 
for a ^-reduction path, we can sometimes avoid the more expensive test. 

Given u, v G G, if supp(w + ) fl supp(t> + ) = 0, then there exists a simple y- 
reduction path from x^ u,v ' to y( u > v ^ using u and v in reverse order (see Figure 
5). 



-< 


z (u,v) 










X y(U,V) 



-< 



z 



Fig. 5. Criterion 1. 



Criterion 2: The Cancellation criterion 

Let G be a generating set of C If supp^"' 1 '')) fl suppd/^'^) 7^ for some 
u,v G G (or equivalently, supp(-u~) fl supp(f~) 7^ 0), then we do not need 
to check for a ^-reduction path from x^'^ to y^ u ^ (we can remove the pair 
(u, v) from C). 
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To show that this criteria holds, we need the concept of a grading. Let w £ Q n . 
If wx = wy for all x, y e J~c,b f° r & U ^ then we call w a grading of £, 

and we define deg^J-'cb) := wb called the ^-degree of J-c,b- Importantly, if 
C fl N n = {0} (which we assume), then it follows from Farkas' lemma that 
there exists a strictly positive grading w G Q™ of C. 

First, we prove an analogous result to Corollary 8. 

Lemma 30 A set G C £^ is a -<-Grdbner basis of C if and only if G is 
a generating set of C and if for every ^--critical path (x,z,y) in Q{Tn^,G) 
for all () 6 Z™ where supp(x) fl supp(?/) = ; there exists a ^--reduction path 
between x and y in G{J~c,b, G). 

Proof. The forwards implication follows from Corollary 8. For the back- 
wards implication, we need to show that for every ^-critical path (x,y, z) 
where supp(x) fl supp(y) 7^ 0, there exists a ^-reduction path from x to y 
in G{J~c,xi G), in which case, there is a ^-reduction path for all ^-critical 
paths, and so by Corollary 8, G is a Grobner basis. Assume on the contrary 
that this is not the case. Let w be a strictly positive grading of C Among 
all such >~- critical paths (x,z,y) where supp(x) fl supp(?/) 7^ and there is 
no ^-reduction path from x to y, choose a ^-critical path (x, z, y) such that 
deg^J-'cx) is minimal. Let 7 := x A y, x := x — 7, and y := y — 7. Note 
that 7 7^ since supp(x) fl supp(y) 7^ 0. Because G is a generating set of C, 
there must exist a path from x to y in G{J~c,x,G). Also, since w is strictly 
positive, deg^J-'cs) < deg w (J-'c,x)', therefore, by the minimality assumption 
on deg w (J-'c,x) , we can now conclude that for all ^-critical paths in G{Fc,x, G) 
there exists a >~ reduction path. Consequently, by Lemma 6, there exists a 
^-reduction path between x and y in G{J~c,x, G). This ^-reduction path, how- 
ever, can be translated by 7 to a ^-reduction path from x to y in G{J~c,x-, G) 
(see Figure 6a). But this contradicts our assumption that there is no such path 
between x and y. □ 




Fig. 6. Criterion 2. 



Now, for all u, v E G, if supp^"' - "**) fl supp(?/ M ' t '- ) ) 7^ 0, then supp(x) fl 
supp(y) 7^ for all ^-critical paths (x,z,y) for (u,v). Using this observa- 
tion, we arrive at an analogous result to Corollary 10. 
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Corollary 31 Let G C £ be a generating set of C; then, G is a -<-Grdbner ba- 
sis of C if and only if for each pair u,v G G where supp(x^ u,1 '- ) ) flsupp(?/( u '^) = 
7 there exists a >- -reduction path between x^^ and y( u ^ in Q(J r CtZ (u,v),G). 

We can extend these results further leading to a more powerful elimination 
criterion. Let u,v G G. We say the pair (u, v) satisfies Criterion 2 if there exists 
x',y' G J r Cz (u,v) such that there exists a ^-decreasing path in Q[T ^ z (u,v), G) 
from x( u ' v ) to x' and from y( u > v "> to y', and supp(rr') flsupp(y') 7^ 0. Importantly, 
if (u, v) satisfies Criterion 2, then we do not have to test for a ^-reduction 
path from x^ u ^ to y( u ' v \ Thus, we arrive at an extension of Corollary 31. 
Observe that the previous results are just a special case where x' = x^ u ' v ^ and 

Lemma 32 Let G C C be a generating set of C; then, G is a -<-Grdbner basis 
of £ if and only if for each pairu, v G G where (u, v) does not satisfy Criterion 
2, there exists a ^--reduction path between x^ u,v ^ and y^ u ^ in Q(J r CtZ (u,v),G). 

If there is a ^-reduction path from x' to y', then there exists a ^-reduction 
path from x^ u,v "> to y( u > v \ Since supp(x') fl supp(y') 7^ 0, then 7 = x' A y' 7^ 0. 
Let x = x' — 7 and y = y' — 7. So, if there exists a ^-reduction path from 
x to y, then there must exist a ^-reduction path from x' to y', and therefore 
also, there must exist a ^-reduction path from x^ u ' v ^ to 

y {u,v) ( gee 

Figure 

6b). Again, we let to be a strictly positive grading of C, and so similarly to 
above, deg^J-'cx) < deg w (jF £ jZ ( u ,v)). So, the proof of Lemma 32 is essentially 
as before. 

For a pair u, v G G, Criterion 2 can be checked not only before we search 
for a ^-reduction path from x^ u ' v ^ to y( u ' v ^ but also while searching for a 
^-reduction path. When searching for a ^-reduction path, we construct a 
^-decreasing path from x^^ to J\fF(x( u ^ , G) and a ^-decreasing path from 
y(u,v) ^ Q j\fj?(y («>") j (7), Therefore, we can take any point x' on the ^-decreasing 
path from x M to UT{x^ v \G) and any point y' on the decreasing path from 
y(u,v) ^ Q j\ff(y( u < v )^G) and check Criterion 2, that is, we check if supp(V) fl 
supp(y') 7^ 0. If this is true, then we can eliminate (u, v). 

We wish to point out explicitly here that Criterion 2 can be applied without 
choosing the vector pairs u, v G G in a particular order during Algorithm 2. 
In fact, when running Algorithm 2, if we apply Criterion 2 to eliminate a pair 
u,v G G, it does not necessarily mean that there is a ^-reduction path from 
to y M in Q[J- £ 2 ( u ,„) , G) at that particular point in time in the algorithm 
but instead that a ^-reduction path will exist when the algorithm terminates. 
This approach is in contrast to existing approaches that use the homogeneous 
Buchberger algorithm to compute a Grobner basis whereby vector pairs u,v G 
G must be chosen in an order compatible with increasing deg w (J-' Cz (u,v)) for 
some strictly positive grading w. This can be computationally costly. When 
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we use these existing approaches, if a pair (u, v) is eliminated by Criterion 
2, then it is necessarily the case that there already exists a ^-reduction path 
from to y( u > v \ 

Since we need a generating set of £ for Criterion 2, we cannot apply Criterion 
2 during the Saturation algorithm (Algorithm 3), and also, we cannot apply 
Criterion 2 when £ PI N™ ^ {0}. However, we can apply a less strict version. 
Given u,v G G and r C {l,...,n}, we say that (u, i?) satisfies Criterion 2 
with respect to r, if there exists x',y' G J r Cz (u,v) such that there exists a 
decreasing path in £/(.F£ z (u,v), G) from x'"' 1 ') to x' and from i/"- 1 ') to y', and 
supp(x') fl supp(y') R t 7^ 0. 

Let S,T C £ where S spans £ and T is a cx-saturated set on S for some 
a C {1, . . . ,n}. During an iteration of the Saturation algorithm 3, we compute 
a (cr U {z})-saturated set of S, by computing CV(~< S i,T). While computing 
C7- , (-<gi, T) here, we may apply Criter ion 2 with respect to a. For an algebraic 
proof of this, see Bigatti et al. ( 1999i l. 



Also, we can use Criterion 2 when £ fl N n ^ {0} if we have a generating set 
of £. Let r be the set of bounded components. Then, we may apply Criterion 
2 with respect to r. Moreover, if we do not have a generating set and we are 
running the Saturation algorithm when £nN™ 7^ {0}, we may apply Criterion 
2 with respect to a fl r. 



Criterion 3: The (u,v,w) criterion 

Before presenting the (it, v, w) criterion, we need a another result, Lemma 33, 
that is a less strict version of Lemma 6. First, we need to define a new type 
of path. A path (x°, . . . , x k ) is z-bounded (with respect to -<) if x l -< z for 
all i = 0, . . . , k. So, z is a strict upper bound on the path. Note that for a 
^-critical path (x, z,y), a ^-reduction path from x to y is a ^-bounded path. 

Lemma 33 Let b G 7L n , x, y G J-c,b, and let G C £ y where there is a path 
between x and y in G{Tc,b,G). If there exists a z' -bounded path between x' 
and y' for every y-critical path (x',z',y') in G(Fc,b,G) , then there exists a 
^--reduction path between x and y in G(J-£ t b, G). 

If we now re-examine the proof of Lemma 33, we find that we only need 
^'-bounded paths between x' and y' for every ^-critical path (x',z',y') in 
G{^c,bi G), and that, a ^-reduction path from x' and y' is more than we need. 
The proof proceeds in the same way as Lemma 6. 

^From Lemma 33, we arrive at an analogous result to Corollary 10. 

Corollary 34 A set G C £ y is a -<-Grobner basis of £ if and only if G is a 
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generating set of £ and if for each pairu,v G G, there exists a z^ u > v ' -bounded 
path between x^ u ' v > and y( u > v > in Q{T £ z (u,v), G). 

Corollary 34 does not fundamentally change Algorithm 2 since to test for a 
z vu,v) -bounded path from x^ u ' v ^ to y( w > v \ we still test for a ^-reduction path 
from x^'^ to y( u > v ) which is a z^ u ' v " '-bounded path. However, we can use Corol- 
lary 34 to reduce the number of critical pairs u,v G G for which we need to 
compute a ^-reduction path. 

Now, we are able to present the (u,v,w) criterion. Let u,v,w G G where 
z (u,v) > w + ( Qr equivalently, z {u > v) > z {u > w) and z^ > z^), and let z = 
z {u,v) _ w Tben, a z^^ -bounded path from x^ u,w ^ to z, and a ^"'"'-bounded 
path from z to y( w < v *> combine to form a z ( - u ' v ^ -bounded path from x^ u ' v ^ to y( u > v >. 
Moreover, (x^ u,v \ z^ u,v \ z) is a ^-critical path for (u, w) and (z, z ( u ' v ) ; y( u > v )^ j s 
a ^-critical path for (w,v) (see Figure 7). Therefore, a ^"'""'■'-bounded path 
from x^ u ' w ' to y^' 1 ") and a ^""'^-bounded path from x^''") to y( w > v > combine to 
form a z^ u ' v ^ -bounded path from a^"'^ to y( u < v \ and so, we can remove (tt, i>) 
from C. 





Fig. 7. Criterion 3. 

Note that in Figure 7a, a ^-reduction path from x^'^ to z and a ^-reduction 
path from z to do combine to give a ^-reduction path from x^'^ to 

y{u,v).^ bowever, this is not the case in Figure 7b which is why we need the 
concept of bounded paths. 

We can extend the previous result. Let u, v, G G, and w 1 , . . . , w k G G where 
z (u,v) > ( w ^ + f or alii = 1, . . . , fc. If there exists a bounded path for the critical 
pairs (u, w 1 ), (w k , v), and (w l , w l+1 ) for all i — 1, . . . , k — 1, then there is a 
bounded path for (u,v). However, note that this can also be implied by a 



bounded path for (u, w l ) and (w % , v) for any i 



k. 



Unfortunately, we cannot just remove from C all pairs u,v G G where there 
exists a w G G such that z^ > w + . It may happen that in addition to 
z (u,v) > u ,+^ we a j go bave z^™) > in which case, we would eliminate 
both the pairs (u,v) and (u, w) leaving only (v,w) which is not sufficient. 
Moreover, at the same time, we may also have z^'^ > u + , and we would 
elimin ate all three pairs. To avoid these circular relationships, Gebauer and 
Moller Gebauer and Moller ( 1988| ) devised the following critical pair elimina- 
tion criteria which we use in practice in 4ti2 vl.2. 
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Let G = {u 1 , u 2 , . . . , -ul G l}, and let u\ G G where i < j. We define that the 
pair (u l ,ui) satisfies Criterion 3 if there exists u k G G such that one of the 
following conditions hold: 

(1) z^' u ^ > z {ul ' uk \ and z^') > z^'^); 

(2) = z ^' uk \ z iut ' uJ) > z^' uk \ and k < j; 

(3) ;z ( " l '" J) > z("^) = ^««*), and k < z; or 
j 4 j z {u\ui) = z (u i ,u k ) = z (uJ,u k )^ an dk<i<j. 

So, if a pair (u l ,v?) satisfies Criterion 3, we can eliminate it. For example, if 
G = {m 1 ,^ 2 ,^ 3 } where z" = z u " > z u u , then applying Criterion 3 to all 
three pairs (u 1 ,^ 2 ), (-a 1 ,?/ 3 ), and (u 2 ,n 3 ) would eliminate only (u 1 ,^ 3 ). 

After eliminating all pairs that satisfy Criterion 3, we are left with a set of 
critical pairs C C C = {(u, v) : u, v G G} such that if there exists a 2^" )- 
bounded path from x <yU ' ,v ^ to y( u '> v ''> for all (u',v f ) G C", then there exists a 
^"'^-bounded path from x^ u ' v ' to y^ u ' v ^ for all (it, t> ) G C. However, this set of 
pairs may not be minimal. Tn ICaboara et al.1 », Cab oara, Kreuzer, and 



Robbiano describe an algebraic algorithm for computing a minimal set of crit- 
ical pairs with computational results. Their computational results show that 
the Gebauer and Moller criteria give a good approximation to the minimal set 
of critical pairs. We found that the Gebauer and Moller criteria were sufficient 
for our computations. 



6 The 4 x 4 x 4-challenge 



The challenge posed by Seth Sullivant amounts to checking whether a given 
set of 145, 512 integer vectors in Z 64 is a Markov basis for the statistical model 
of 4 x 4 x 4 contingency tables with 2-marginals. If x = (xijk)i,j,k=i,...,4 denotes 
a 4 x 4 x 4 array of integer numbers, the defining equations for the sampling 
moves are 

4 

J2 x ijk = for j, A; = 1,...,4, 

8=1 
4 

Y^ x m = for i, k = 1, . . . ,4, 

3=1 
4 

%ijk = for i,j = 1, . . . ,4. 

k=i 

This leads to a problem matrix A444 G Z 48x64 of rank 37 and £a 444 = {z '■ 
A 4i 4Z = 0, z G Z 64 }. Note that the 145, 512 vectors in the conjectured Markov 
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basis fall into 14 equivalence classes under the natural underlying symmetry 
group S4 x S4 x S4 x S3. 



In Aoki and Takemura (2003). Aoki and Takemura have computed these 14 



symmetry classes via an analysis of sign patterns and under exploitation of 
symmetry They claimed that the corresponding 145, 512 vectors form the 
unique inclusion-minimal Markov basis of A444. 

Using our Project-and-Lift algorithm, however, we have computed the Markov 
basis from the problem matrix A444 within less than 7 days on a Sun Fire 
V890 Ultra Sparc IV processor with 1200 MHz. Note that the symmetry of 
the problem was not used by the algorithm. This leaves room for a further 
significant speed-up. Our computation produced 148, 968 vectors; that is, there 
are additionally 3,456 Markov basis elements. These vectors form a single 
equivalence class under S4 x S4 x S4 x S3 of a norm 28 vector z i5 (or equivalently, 
of a degree 14 binomial). 

A quick check via a Hilbert basis computation with 4ti2 shows that these 
Markov basis elements are indispensable, since {z G Z^ 4 : A^z = A^zf^} = 
{^15,^15}- As also all the other 145,512 Markov basis elements were indis- 
pensable, the Markov basis of 4 x 4 x 4 contingency tab les with 2-marginals 



i s ind eed unique. At least this claim can be saved from lAoki and Takemura 



(2003). although we have finally given a computational proof. Here is the list 



of the 15 orbit representatives, written as binomials: 



(1) X111X144X414X441 - X114X141X411X444 

(2) X111X144X334X341X414X431 - X114X141X331X344X411X434 

(3) XiiiXi22^134^143^414£423^432£441 ~ ^114^123^132^141^411^422^434^443 

(4) X111X144X324X333X341X414X423X431 - X114X141X323X331X344X411X424X433 

(5) XiiiXi4 4 X234^243^323^34i:£414£42l£433 ~ Zll4£l4l£233£244£32l£343£41l£423^434 

(6) XmXi22£l33^144£324^332£341^414£423^431 - 

^114^123^132^141^322^331^344^411^424^433 

(7) XiiiXi44X 2 22^234»243^323a?34i:E414a;421^432 ~ 
Xii 4 Xl4lX223a;232X244X32lX343^41lX422X434 

(8) X m Xi 44 X222^233£324:r332£34l£414£423^431 ~ 
Xn4Xi4iX223^232^322a;331^344a:411^424a:433 

(9) XiiiXii2Xi33Xi 44 X223^224^232:£24l£314£322:£413^421 ~ 
^113^114^132^141 ^22lK222 «233^244«312:E324^411^423 

(10) X m Xii2Xi33Xi44X224^232^243^313^322^34i:E414;E421 ~ 
^113^114^132^141^222^233^244^312^321^343^411^424 
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(11) X m Xi34^143^222^233^241^314^323^342^4122;4242;431 ~ 
^114^133^14l£223^231^242^312^324^343^41l2;4222;434 

(12) XiiiXi34Xi4 3 X2242;232a;24l2;314a;323^342a;412a;42ia:433 ~ 
^114^133^141^221^234^242^312^3242; 343^411^423^432 

(13) X? 11 Xi24Xi33Xi44X 2 14^223^242^313^332a;341 ^414^424^431 ~ 
^114^123^131^141^213^2222; 244^311^333^342^411^424^432 

(14) £? 11 £l 2 4»133^1M»214»232»243^312«323^341»414^422a?431 ~ 
«114^123»131^141»212»233»244^311»322^343»411^4242;432 

(15) xf 11 Xl33»144^223 »224»232»242^313«322^341«414Z;422a?431 - 
^113^114^131^141^222 x 233Z244^311^323^342^41l2;4242;432 



7 Computational experience 



We now compare the i mplementation of our new algorithm in 4ti2 v.1.2 



Hemmecke et alll2005fl with the implementation of the Saturati on algorithm 



Ho^n ,„H tt^h^^MU-d-P,** algorithm i Ri^ta, ! 



1999h in Sing „!a r v.TO kir^ „t a ll m (algorithmic options 'hs' and 



blr') and in CoCoA 4.2 (|CoCoATeaml . l2005l) (functions 'Toric' and 'Toric. Sequential' 



Name 


Software 


Function 


Algorithm 


Sing-blr 


Singular v3.0.0 


toric, option "blr" 


Lift-and-Pro j ect 


Sing-hs 


Singular v3.0.0 


toric, option "hs" 


Saturation 


CoCoA-t 


CoCoA v4.2 


Toric 


Lift-and-Pro j ect 


CoCoA-ts 


CoCoA v4.2 


Toric. Sequential 


Saturation 


P&L 


4ti2 vl.2 


groebner 


Project-and-Lift 


4ti2-gra 


4ti2 vl.2 


graver 


Graver basis ( Hemmecke. 2004) 



The first 4 problems correspond to three-way tables with 2-marginals, whereas 
KA and K5 correspond to the binary models on the complete graphs and 
ifs, respectiv e ly. T he problem s-magic333 is taken from an application in 
Ahmed et al. (2003) and computes the relations among the 66 elements of the 
Hilbert bas is elements of 3 x 3 x 3 semi-m agic hypercubes. The example grin is 
taken from Hosten and Sturmfelsl (|l995h . while the examples hppil0-hppil4 
correspond to the computation of hom ogeneous p r imitiv e partition identities, 
see for example Chapters 6 and 7 in Sturmfela ( 1996J ). Fi nally, the exam 



pies c uwwl-cuww5 arise from knapsack problems presented in lCornueiols et al. 

(1223). 
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The computations were done on a Sun Fire V890 Ultra Sparc IV processor with 
1200 MHz. Computation times are given in seconds, rounded up. See Figure 
8. The running times give a clear ranking of the implementations: from left to 
write the speed increases and in all problems, the presented Project-and-Lift 
algorithm wins significantly. 



Problem 


Vars. 


GB size 


Sing-blr 


Sing-hs 


CoCoA-t 


CoCoA-ts 


P&L 


4ti2-gra 


333 


27 


110 


30 


4 


1 


1 


1 




334 


36 


626 




197 


3,024 


5 


1 




335 


45 


3,260 




23, 700 




233 


27 




344 


48 


7, 357 








2,388 


252 




K4 


16 


61 


1 


1 


1 


1 


1 




K5 


32 


13,181 






13,366 


2,814 


715 




s-magic333 


66 


1,664 






35 


55 


3 




grin 


8 


214 


4 


4 


1 


1 


1 




hppilO 


20 


1,830 


1,064 


483 


16 


14 


3 


2 


hppill 


22 


3,916 


15,429 


3,588 


129 


82 


13 


11 


hppil2 


24 


8,569 




43, 567 


1,534 


554 


60 


51 


hppil3 


26 


16,968 






8,973 


4,078 


290 


259 


hppil4 


28 


34, 355 








30, 973 


1,219 


1,126 


cuwwl 


5 


5 










1 




cuww2 


6 


15 










1 




cuww3 


6 


16 










2 




cuww4 


7 


7 










1 




cuww5 


8 


27 










2 





Fig. 8. Comparison of computing times. 

The advantage of our Project-and-Lift algorithm is that it performs compu- 
tations in projected subspaces of C. Thus, we obtain comparably small inter- 
mediate sets during the computation. Only the final iteration that deals with 
all variables reaches the true output size. In contrast to this, the Saturation 
algorithm usually comes close to the true output size already after the first 
saturation and then continues computing with as many vectors. See Figure 
9, for a comparison of intermediate set sizes in each iteration for computing 
3x4x4 tables. 
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5000 








Fig. 9. Comparison of intermediate set sizes in each iteration. 

Moreover, the Project-and-Lift algorithm, performs Grobner basis computa- 
tions using a generating set, and thus can take full advantage of Criterion 2 
which, as computational experience shows, is extremely effective. In fact, we 
only applied Criterion 2 and 1 (applied in that order) for the Project-and-Lift 
algorithm since Criterion 3 only slowed down the algorithm. However, for the 
Saturation algorithm where we cannot apply Criterion 2 fully, Criterion 3 was 
very effective. In this case, we applied Criterion 1, then 3, and then 2, in that 
order. 



Note that in the knapsack problems cuwwl-cuww5 the initial set a chosen by 
the Project-and-Lift Algorithm 4 is empty. Thus, Algorithm 4 simplifies to 
the Saturation Algorithm 3. In fact, only a single saturation is necessary for 
each problem. 

To us, the following observations were surprising. 

• While Singular did not accept the inhomogeneous problems cuwwl-cuww5 
as input, CoCoA either could not solve them or produced incorrect answers. 

• It is not clear why the CoCoA function Toric works well on problems 
hppil0-hppil4, but runs badly on the table problems 334, 335, 344. 

• Problems hppilQ-hppil 4 are in fact Gr aver basis computations (see for 
example Chapter 14 in Sturmfelsl ( 1996f )). for which 4ti2 has the state- 



of-the-art algorithm and implementation. Initially, it was a surprise to us 
that our Project-and-Lift Algorithm 4 comes so close to the speed of the 
state -of-the-art algorithm that computes Graver bases directly ( Hemmeckel . 



2004). However, it turns out that our Project-and-Lift Algorithm 4 is an 



extension of the Project-and-Lift algorithm presented in iHemmeckel (J2004J) 
to lattice ideal computations. 
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